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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1 .1 14, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
December 3, 2004 has been entered. 

Response to Amendment 

2. Applicants' amendment filed December 3, 2004, has been entered and made of 
record. 

3. Objection to Claims 1-21 has been withdrawn in view of Applicants amendment. 

4. 35 U. S. C. 112, second paragraph rejection of Claims 1 and 7 regarding 
indefiniteness in original Step c has been withdrawn in view of Applicants amendment. 

5. 35 U. S. C. 112, second paragraph rejection of Claims 1 , 7 and 16 for lack of 
antecedent basis has been withdrawn in view of Applicants amendment. 

Response to Arguments 

6. Applicants have referred to the same reasons as presented for in the amendment 
filed October 26, 2001 for the rejection of Claims 1 to 19 and 21 under 35 USC 103(a). 
Applicants are respectfully directed to the response to these arguments in Office Action 
mailed on June 3, 2004 (Paper # 12). 

7. In response to applicants further arguments that the examiner's conclusion of 
obviousness is based upon improper hindsight reasoning, it must be recognized that 
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any judgment on obviousness is in a sense necessarily a reconstruction based upon 
hindsight reasoning. But so long as it takes into account only knowledge which was 
within the level of ordinary skill at the time the claimed invention was made, and does 
not include knowledge gleaned only from the applicant's disclosure, such a 
reconstruction is proper. See In re McLaughlin, 443 F.2d 1392, 170 USPQ 209 (CCPA 
1971). 

8. It is further submitted that the amended Claim 1 merely recites the definition of 
correlation which is well known in the art. No details have been provided regarding the 
specific correlation process of Applicants 1 invention. 

Information Disclosure Statement 

9. The receipt of a copy of Non-Patent Literature (Author Serra) is acknowledged. 

10. A concise explanation of the relevance of Foreign Patent Document FR 91 15308 
is instantly required for deciding the patentability of the claimed subject matter of the 
Applicants 1 invention. 

Claim Rejections - 35 USC § 112 

1 1 . The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

12. Claims 1-16 are rejected under 35 U. S. C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

In Claims 1 , Lines 11-13, "matching a generated target window of chosen 
dimensional characteristics and containing the selected target region of interest around 
pixels of the selected target" is vague and indefinite. 
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In Claims 7, Lines 11-13, "matching a generated target window of chosen 
dimensional characteristics and containing the target region of interest around the 
selected target pixels" is vague and indefinite. 

It is not clear to which region the generated target window will be matched. 
Claim Rejections - 35 USC § 103 

13. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

14. Claims 1, 6, 7 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Robb et al (U.S. 5,568,384) in view of Mick et al (U.S. 5,261 ,404). 

As per Claim 1 Robb teaches: 

providing a set of images having at least first and second digitized stereotaxic 
images having positions of homologous regions of interest corresponding to the element 
of interest and appearing in the set of stereotaxic images (volume images, Column 3, 
Lines 55-60); 

selecting in a first stereotaxic image a first (base image) target region of interest 
having a target pixel (Column 3, Line 58); 

matching the first target region of interest with a second region of interest (object 
contour) homologous to the first target region of interest and appearing in the second 
region of interest (Column 3, Line 61 through Column 4, Line 10); 
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matching a generated target window of chosen dimensional characteristics and 
containing the selected target region of interest around pixels of the selected target 
(Column 3, Line 55 through Column 4, Line 5); 

determining a set of pixels (limited number of points, Column 4, Lines 5-9) in the 
second stereotaxic image according to a predetermined selection criterion so as to 
generate a second window having the same dimensional characteristics as the target 
window around each selected pixel (Column 4, Lines 5-9); 

Robb's teachings regarding the image registration generally disclose the 
correlation between images. In the process of correlation, essentially, correlation 
process will be performed between the pixels in windows (blocksO of the first and 
second regions of interest. 

However, for further emphasis, Mick et al's teachings are further relied upon 
concerning: 

applying a correlation process to the pixels in windows of the set of stereotaxic 
images corresponding to the first and second regions of interest and applying a 
correlation process between the windows (Column 6, Lines 3-50); 

processing a correlation between the gray-scale levels of the pixels in each 
second window to obtain a correlation for each second window (Column 6, Lines 3-50); 

using the correlation values to identify the region of interest homologous to the 
target region of interest (Column 6, Lines 50-65, Column 8, Lines 6-15) and thereby 
minimize the risk of matching error between the homologous regions of interest. The 
last phrase of this sentence ("minimize the risk of matching error between the 
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homologous regions of interest") is a well-known feature of pattern recognition and 
typically strived for by all matching systems. 

It would have been obvious to one of ordinary skill in the art to utilize the 
teachings of Mick to provide the image processing techniques using correlation to 
identify a target region in a first and second image to matched by Robb to allow a 
physician the opportunity to traverse the anatomy prior to penetrating it with instruments 
to establish the optimum route through the anatomy. 

As per Claim 7, it recites generally the same limitations as Claim 1 above and 
analogous remarks apply. Claim 7 is a broader version of Claim 1 and therefore 
rejectable for the same reasons. 

As per Claims 6 and 15, which recite the matching includes a prior filtering of the 
stereotaxic images (OFFICIAL NOTICE). First, it would have been obvious to one of 
ordinary skill in the art to perform some initial filtering to remove any signal distortions 
caused by patient movement or noise introduced by system sensors. Second, the 
applicant admits this is well known citing an article from 1988 on page 17, Lines 12-17 
of his specification. 

15. Claims 2 and 3 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Robb and Mick as applied to Claim 1 above, and further in view of Gerstenberger, (U.S. 
5,220,441). 

As per Claim 2, Mick does not teach the specifics of his correlation method. 
However, Gerstenberger does teach: 

wherein the correlation values includes the selection of a certain number 
(tiepoints, Column 2, Lines 35-50) of correlation maxima or minima, the homologous 
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region of interest being selected from those for which the associated correlation value is 
one of the correlation maxima or minimum (Column2, Lines 50-56). 

It would have been obvious to one of ordinary skill in the art to utilize the 
correlation algorithms as taught by Gerstenberger in correlating the stereotaxic images 
of Robb and Mick to rapidly determine the degree of offset between two images thereby 
overcoming resolution and precision limitations. 

As per Claim 3, Gerstenberger teaches: 

wherein an analysis of the correlation values obtained includes a determination 
of the dynamic range of the maxima or minima selected, and the comparison of the 
dynamic values obtained with a threshold (Column 3, Lines 3-8). 

16. Claim 4 is rejected under 35 U. S. C. 103 (a) as being unpatentable over Robb 
and Mick as applied to Claim 1 above, and further in view of Russ, The Image 
Processing Handbook, 2nd Edition, CRC Press, 1994. 

As per claim 4, Robb and Mick do not specifically teach: 

the correlation processing includes a normalized correlation processing. 

However, Russ teaches that normalized correlation is a basic form of correlation utilized 

in image processing (Page 342). 

It would have been obvious to one of ordinary skill in the art to utilize the 

well-known features as taught by Russ in the correlation of images as taught by Robb 

and Mick in order to prevent erroneous results from spurious correlation values. 

17. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Robb and 
Mick as applied to claim 1 above, and further in view of Pratt, Digital Image Processing. 
Second Edition, Wiley& Sons, 1991. 



Application/Control Number: 09/214,822 Page 8 

Art Unit: 2623 

As per Claim 5, Robb and Mick do not specifically teach using normalized 
difference processing. However, Pratt teaches: 

wherein the correlation processing includes a normalized difference processing 
(p. 669). 

It would have been utilize the absolute difference error to as taught by Pratt in the 
correlation system of Robb and Mick in order to determine the proper misregistration 
offset which is normalized to take into account the different imaging systems, patient 
motion, etc. that may effect the alignment of the stereotaxic images. 
18. Claims 8-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Robb and Mick as applied to claims 1 and 7 above, and further in view of Kenet et al., 
(Kenet), U.S. 5,836,872. 

As per Claim 8, Robb et al and Mick et al do not explicitly disclose that the 
predetermined characteristics comprise shape contrast, or gradient characteristics. 
However, Kenet does teach such a limitation (Column 14, Line39). 

It would have been obvious to one, of ordinary skill in the art to utilize the body 
imaging and classification of body surface and subsurface features techniques as 
taught by Kenet in the imaging system of Robb and Mick to improve the accuracy of 
quantification and classification of anatomical and physiological features of the human 
retina (luring three-dimensional imaging. 

As per Claim 9, Kenet teaches: 

wherein the comparison processing includes a distance minimization processing 
between the two sets of numerical values (Column 14, Lines 52-61). 
As per Claim 10, Kenet teaches: 
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wherein the comparison processing includes a distance minimization processing 
between the two sets of numerical values (Column 14, Lines 52-61). 

As per Claims 11 and 12, which depend upon claims 1 and 7 respectively, Kenet 
teaches: 

wherein an epipolar zone containing at least the epipolar segment relating to the 
target pixel is determined in the second stereotaxic image and the pixels in the epipolar 
zone contain the selected pixels (Column 14, Lines 47-75). 

As per Claims 13 and 14, which depend upon claims 1 and 7 respectively, Kenet 
teaches: wherein the selected pixels are chosen from the pixels in the second image 
which have a gray-scale level maxima or minima whose dynamic range is greater than 
a predetermined threshold (Column 14, Lines 40-43). 

19. Claims 16-19, and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Robb. 

As per Claim 16, Robb teaches: 

providing a set of digitized stereotaxic (volume images, Column 3, Lines 55-60) 
images having positions of homologous regions of interest corresponding to the element 
of interest and appearing in the set of stereotaxic images (Column 1 , Lines 30-31 , 
Column 2, Lines 17-23); 

selecting in a first stereotaxic image of a first target region of interest (base 
image, Column 3, Line 58); 

selecting a second stereotaxic image on the basis of the a first automatic 
matching of at least a second region of interest (match image, Column 3, Line 59., and 
Column 4, Lines 15-60); 
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determining the spatial position of a candidate pixel of a candidate element of 
interest corresponding to the two regions of interest (Column 3, Line 60 through Column 
4, Line 9); 

determining the position, in a third stereotaxic image of a projected pixel 
corresponding to the projection into the third stereotaxic image of the candidate pixel. 
Robb does not specifically teach such a feature, but he does provide suggestion that his 
system is capable of performing such a function. In Column 1, Lines 29-31, Robb states 
that one or more images are transformed to bring them into spatial registration with 
another. This statement indicates that Robb's method is a sequential method operating 
on two image surfaces at a time until all of the image surfaces desired to be registered 
are matched. Also in Column 2, Lines 49-55, Robb states that the geometric 
transformation accommodates images of different position , orientation, and size, 
thereby not limiting himself to only two image surfaces. Further in line 54 of Column2, 
Robb teaches that his system will adjust the image surfaces to the best fit that 
minimizes the cost function. 

If the process of Robb were sequential then the following step would also be 
taught as the first automatic matching. Robb teaches providing a second automatic 
matching between the target region of interest and a vicinity of the projected pixel 
(Column 3, Line 59, and Column 4, Lines 15-60). defining a projected region of interest 
so as to minimize the risk of matching errors between the homologous regions of 
interest (cot. 4, Lines 5-10). 
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As per Claim 17, Robb teaches: wherein the selecting in the second stereotaxic 
image is on the basis of the first automatic matching a set of second regions which may 
be homologous to the target region; 

determining the spatial position of each candidate pixel corresponding to each 
pair of regions of interest (match surface points, Column 4, Line 57) which is formed by 
the target region and one of the second regions; 

determining the spatial position in the third image of each corresponding 
projected pixel; and performing the second automatic matching between the target 
region and vicinity of each projected pixel (Column 4, Line 16 through Column 5, Line 
45). 

As asserted above in the rejection of Claim 16, the system of Robb would use 
two images and then integrate the solution of the first matching into the determination of 
an optimal minimized cost function utilizing the next image to be registered. 

As per Claim 18, Rob teaches: 

wherein the set of second regions obtained is ordered in the decreasing order of 
their probability of being in the region homologous to the target region (Column 6, Lines 
53-60). One of ordinary skill in the art would have been able to determine a match 
probability from the resulting local minimum. 

wherein the set of projected regions obtained is ordered in the decreasing order 
(This is a design choice.) of their probability of being the region homologous to the 
target region to form a list of correlated values in decreasing order (Column 6, Lines 
60-63); and 
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wherein the region homologous to the target region is selected as being the one 
based upon such ranking (Column 6, Line 62). 

As per Claim 19, Robb does not explicitly teach a first automatic matching is a 
correlation processing matching. 

Automatic correlation matching is a well known image processing methodology 
for matching reference and target images (Official Notice). 

It would have been obvious to use the image contour features of Robb in 
conjunction with the automatic correlation to provide a system using spatially correlated 
information that enhances medical diagnosis of a given location of interest in the body. 

As per Claim 21 , Robb teaches: 

wherein the second automatic matching includes a comparison matching 
between the target region of interest and each projected region of interest (Column 4, 
Lines 16-20). 

Contact Information 

20. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mehrdad Dastouri whose telephone number is (571) 
272-7418. The examiner can normally be reached on Monday to Friday from 8:00 a.m. 
to 4:30 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (571 ) 272-7414. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Mehrdad Dastouri 
Primary Examiner 
Art Unit 2623 
April 16, 2005 




